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METHOD AND APPARATUS 



FOR IMPLEMENTING WAVELET FILTERS IN A DIGITAL SYSTEM 



CROSS REFERENCE TO RELATED APPLICATION 



5 



This application is a divisional of U.S. application Serial No. 09/221,434, filed on 
December 28, 1998, by Yolanda Prieto et al., entitled "Method and Apparatus for 
Implementing Wavelet Filters in a Digital System," previously filed and assigned to 
Motorola, Inc. 



10 



TECHNICAL FIELD 



This invention relates in general to data compression and particularly to digital data 
compression. Specifically, the invention relates to a method and apparatus that provides 
improved wavelet filter operation for digital data systems. 



With the advent of technologies and services related to teleconferencing and digital 
image storage, considerable progress has been made in the field of digital signal 
processing. As will be appreciated by those skilled in the art, digital signal processing 
typically relates to systems, devices, and methodologies for generating a sampled data 
20 signal, compressing the signal for storage and/or transmission, and thereafter 

reconstructing the original data from the compressed signal. Critical to any highly 
efficient, cost effective digital signal processing system is the methodology used for 
achieving compression. 



25 original data signal into a bit stream suitable for communication over a channel or storage 
in a suitable medium. Methodologies capable of minimizing the amount of information 
necessary to represent and recover original data are desirable in order to lower 
computational complexity and cost. In addition to cost, simplicity of hardware and 



15 



BACKGROUND 



As is known in the art, data compression refers to the steps performed to map an 
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software implementations capable of providing high quality data reproduction with minimal 
delay are likewise desirable. 

At present, the next standard of JPEG 2000 (Joint Photographic Experts Group) 
systems for still images proposes algorithms which use a wavelet to achieve decomposition 
5 of an input signal. In systems utilizing a wavelet, the data is typically divided through low 
pass and high pass filters. The implementation of wavelet filters is typically achieved using 
a filter bank and, in many instances, involves several levels of filtering. Filter bank 
operation is often implemented through numerous multiplications and additions between 
the wavelet coefficients and the input data. The process of implementing filter banks can 
1 0 be time consuming unless very fast multipliers are used. Such multipliers typically utilize 
parallel processing, which requires the use of fast clocks with higher current consumption 
as well as requiring larger chip areas in their implementation. 

Some prior art filter banks have eliminated multipliers through the use canonical 
signed digit(s) (CSD). CSD is a powers of two representation of an integer (e.g., 9=2 3 
1 5 +2°). One such filter bank is described by Horng et al. in an IEEE article entitled "The 
Design of Low Complexity Linear-Phase FIR Filter Banks Using Powers-of-Two 
Coefficients with an Application to Subband Image Coding," Vol. 1, No. 4, Dec. 1991. 
This prior art system develops a method for obtaining an optimal representation for the 
low pass filter and high pass filter in the filter bank. The authors' premise is how close the 
20 CSD representation of the filter coefficients is to the infinite precision design. Hence, 

based on this language, Horng et al., have developed "an objective function that will yield 
good filtering performance while adhering to" a constraint equation which embodies the 
well known perfect reconstruction condition. This constraint equation is based on an 
imposed pure-delay requirement implied by perfect reconstruction. To overcome the non- 
25 linearity in this equation, low pass filter coefficients are first restricted to CSD without any 
constraint, then a suitable set of high pass CSD coefficients are obtained by using a 
complex optimization algorithm such that the constraint equation is met. 
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This invention further reduces the set of the optimal representation of CSD coded 
coefficients of the filters in the filter bank, by adaptively selecting a subset of the number of 
CSD terms. 

While certain wavelet transforms are closely linked to the two-band (or two- 
5 channel) perfect reconstruction (i.e,. lossless) filter bank, this is not always the case. 

Wavelet based CODECs are often used in both lossless (perfect reconstruction) and lossy 
(for example systems involving quantization) digital data systems. Quantization refers to 
the technique of taking a bit stream of data and compressing it for later reproduction. In 
most data compression applications, the presence of quantization in a lossy system implies 
1 0 a rate-distortion performance, which usually bounds the quality of the recovered image. 
Thus, a pure-delay requirement on the design and representation of the wavelet 
coefficients is too restrictive, often resulting in implementations that are more complex 
than required. The fiirther reduction in the number of terms used in the CSD 
representation proposed by this invention is based on a system, which includes some 
1 5 method for lossy coding. 

There is a need for a method and apparatus which provides improved wavelet 
filtering for both lossy and lossless digital data systems. Such wavelets should be 
implemented so as to minimize current drain and reduce computational intensity. 



20 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a lossy digital data system in accordance with a first 

embodiment of the invention. 

FIG. 2 is a block diagram of a lossless digital data system in accordance with a 

second embodiment of the invention. 
25 FIG. 3 is a flowchart of a method of CSD-coding wavelet coefficients to obtain an 

optimized filter for a decomposition stage in accordance with the present invention. 
FIGs. 4A and 4B are flowcharts of steps performed in a decomposition stage 

showing an example of a more detailed implementation of the flowchart of FIG. 3 in 

accordance with the present invention. 
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FIG. 5 is a flowchart of steps performed in a decomposition stage in which the 
integer wavelet coefficients are CSD-coded by optimizing signal-to-noise ratio in 
accordance with an alternative embodiment of the inventioa 



5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

While the specification concludes with claims defining the features of the invention 
that are regarded as novel, it is believed that the invention will be better understood from a 
consideration of the following description in conjunction with the drawing figures, in 
which like reference numerals are carried forward. 
10 The invention to be described herein improves the decomposition stage in a digital 

data system and can be applied to three-dimensional (3-D) systems, such as video, two- 
dimensional (2-D) systems, such as still images, as well as one-dimensional (1-D) systems, 
such as speech. 

Referring now to FIG. 1, there is shown a block diagram of a digital data system, 
1 5 such as a CODEC system, in accordance with a first embodiment of the invention. In this 
first embodiment, there is no perfect reconstruction constraint imposed on the system 100. 
Data CODEC 100 includes an encoder 110 and a decoder 120. In accordance with the 
first embodiment, an input data signal s(n) 102, having a predetermined bit/sample 
resolution, goes through a transformation at decomposition stage 112. In accordance with 
20 the invention, decomposition stage 1 12 generates wavelet coefficients and converts them 
to a CSD format, wherein in the process of this conversion an optimal set of CSD 
coefficients are obtained. One of the methods that may be used in this conversion is 
described by Horng et al. in an IEEE article entitled "The Design of Low Complexity 
Linear-Phase FIR Filter Banks Using Powers-of-Two Coefficients with an Application to 
25 Subband Image Coding," Vol. 1, No. 4, Dec. 1991. In accordance with the invention, the 
optimal representation of these CSD-coded wavelet coefficients is then processed, 
considering a lossy system, to further reduce adaptively the number of terms in the CSD 
representatioa Once this is achieved the resulting wavelet filter is used for filtering the 
input signal 102 into the transformed signal x(n) 113. 
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The transformed signal x(n) 1 13 goes through a quantization stage 1 14 for further 
compression. The quantized compressed signal 1 15 is then coded through coding stage 
116 preferably using one of a variety of well known coding schemes. A coded compressed 
signal 1 18 is then communicated over or stored to channel 130. At the receiving end, 
5 decoder 120 employs an inverse coding stage 132, inverse quantization stage and look-up 
table 134, and an inverse decomposition stage 136 to recreate the input data signal s(n) as 
output data signal s'(n) 138. 

Decomposition stage 1 12 preferably performs the data conversion through a 
wavelet transformation such as that proposed in the next standards for JPEG 2000 

10 systems. The transformation used falls under what is called subband coding. Insubband 
coding, whether 1-D, 2-D, or 3-D, the input data signal is repeatedly divided through a 
filter bank of low pass and high pass filters to generate a transformed output consisting of 
subbands. In accordance with the present invention, a series of wavelet coefficients of the 
filter bank are generated into a format, such as integer, floating point, rounded-off floating 

15 point, among others, which can then be converted into a CSD representation. Filtering of 
the input data signal is then performed using the CSD represented wavelet filter. 

The wavelet transformation of the input data signal performed at decomposition 
stage 1 12 of the present invention helps achieve certain multi-resolutional capabilities and 
minimizes blocking effects in the case of image data. In systems where perfect 

20 reconstruction cannot be guaranteed, such as FIG. 1, the use of CSD representation 
applied to all wavelet coefficients provides improved bit rate, lower computational 
intensity and power drain, without degrading system signal-to-noise ratio. 

Blocks 1 14, 1 16, 130, 132, and 134 of FIG. 1 may be implemented in a variety of 
configurations well known or to come. There are several algorithms that may be used to 

25 achieve compression of a data signal at quantization stage 1 14. A well-known quantizer is 
the Lloyd-Max optimal quantizer using nearest neighbor, minimum squared error (MSE) 
rules to classify an input into a specified number of levels. Quantization can be achieved 
through a variety of other approaches including vector, scalar, rounding, truncation, and 
trellis coded quantization (TCQ) among other methods known or to come. Coding stage 
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116 and inverse coding stage 132 can operate through a variety of coding schemes 
including but not limited to arithmetic, Huffman, or other well known coding and decoding 
schemes. Channel 130 may include a wireless, wireline, acoustic, or optically linked path 
such as, for example, a radio frequency (RF) or fiber optic transmission path. The channel 
5 1 30 may likewise be a storage medium such as those now known or later developed. 
Inverse quantization stage 134 can operate through a variety of inverse quantization 
schemes including but not limited to trellis coded quantization, scalar, vector, or others to 
come. The inverse quantization stage 134 decompresses the compressed decoded signal 
133 thereby producing a decompressed signal 135. 

10 In accordance with the present invention, the inverse decomposition stage 136 is 

formed as an inverse discrete wavelet transform (inverse DWT). In accordance with the 
present invention, the inverse decomposition stage 136 utilizes the filter bank of CSD- 
coded wavelet coefficients in order to inverse transform the decompressed signal 135 and 
generate the output signal 138 substantially similar to the input data signal 102. 

15 Wavelet filter banks can also be used in perfect reconstruction systems (i.e. those 

systems where the output signal differs only from the input signal by a constant or pure 
delay). FIG. 2 is a digital data system 200 in accordance with a second embodiment of the 
invention. In system 200 the quantization stages of FIG. 1 have been eliminated, and like 
numerals have been carried forward from FIG. 1 where appropriate. 

20 System 200 includes a lossless coding stage 216 and an inverse lossless coding 

stage 232. The inverse lossless coding stage decodes the coded signal 234 into a decoded 
signal 236. In accordance with the second embodiment, CSD representation is applied to 
all wavelet coefficients obtained from the design of the forward discrete wavelet transform 
(DWT) and the inverse discrete wavelet transform (ID WT). In the decomposition stage 

25 112, this DWT is represented by an analysis bank matrix, H, consisting of analysis low pass 
and high pass filters for the two-channel case, and similarly done for the multi-channel 
case. In accordance with the present invention, the inverse decomposition stage 136 
performs the steps associated with the inverse discrete wavelet transform (IDWT). This 
IDWT is represented by a synthesis bank matrix, G, which in the two-channel filter bank 



-6- 



Atty. Docket: CM02883JD01 
Express Mail # EV 1 16 540 978 US 



consists of the synthesis low pass and high pass filters. The use of CSD representation 
applied to all wavelet coefficients provides reduced computational intensity and improved 
computational speed 

The decomposition stage 1 12 and inverse decomposition stage 136 utilizing CSD 
5 coding of wavelet coefficients, in accordance with the invention, can thus be applied to 
systems that may not include a quantization, but rather including lossless coding with the 
knowledge that perfect reconstruction will not be achieved due to the limitation imposed 
by decomposition stage 1 12. 

The preferred embodiment of the invention is a system where quantization of the 

10 CSD-coded wavelet coefficients occurs. In this lossy system, the powers-of-two 

representation of the wavelet coefficients is not the limiting fector in the system signal-to- 
noise performance. For this reason, the method used to CSD code the coefficient need not 
be complex or cumbersome but rather a simpler method whose fast convergence is 
determined by known, user defined criteria, such as acceptable system peak signal-to-noise 

15 ratio (PSNR), bit rate, and computational intensity. 

As mentioned previously, in systems utilizing a quadrature filter bank, the data is 
typically divided through low pass and high pass filters. In accordance with the present 
invention, adaptive canonical signed digit representation is applied to the entire wavelet 
coefficients to achieve an image that has good peak signal to noise ratio (SNR) and good 

20 bit rate (entropy). This is achieved by a method of filtering the data signal 102 which, in 
accordance with the present invention, comprises the steps of generating a series of 
wavelet coefficients that are integers, representing these integers in a canonical signed digit 
(CSD) form (i.e., powers of two), and filtering the data signal according to the CSD 
representation. 

25 For example, without any loss of generality, in the one-dimensional case: 

*(«)=Z h k (n)s(n) 

0) 



where: 
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s(n) are the input data samples; 

h(n) are the k - coefficients of a filter impulse response represented in CSD 

form; 

x(n) is the filtered input (i.e. output of the decomposition stage 1 12) 

5 

After finding the Z-transform of equation (1) and representing it in matrix form, the 
following is obtained: 

X(z) = H(z)S(z) (2) 

10 A simple extension can be made for two-dimensional; and three-dimensional cases 

if separable transforms are assumed. 

For the finite impulse response (FIR) case, the filter coefficients are expressed in 
integer values as: 

H(z) = 1/A (bo + b 1 z I + bzz 2 + ... + bkZ k ) (3) 

15 where 

bi are integer values for i = 0,1,.. .k 
A = 2 P (exact power of two) 
In general each bi is represented in powers of two as: 

b i -^s(2 p ) (4) 

20 where s is the sign bit; and 

p is the power. 



Specifically, each integer coefficient, bi , can be expressed by its power-of-two 
representation given by: 

25 

(5) 

where: 

a(n) = -l,0, 1,; 
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N= number of terms used to represent each integer coefficient; and 
p(n) = 0,1,2,... N-l represents the power-of-two (e.g., 2° for p(n) = 0) 
V is the i-th integer coefficient which, given a sufficiently large value of N, 
can either minimize or zero the error. The error is defined as the difference between the 
5 exact value wavelet coefficient bi and its approximated value V. 

The step of filtering comprises the step of convolving the data input with the CSD- 
coded wavelet coefficients. Multiplication reduces to simple shifts. 

In accordance with the present invention, the value of N (in equation 5) may be 
selected and optimized independently for each coefficient by the use of adaptive CSD 
10 coding; that is, depending on the importance of the wavelet coefficient, computational 
intensity, output image signal-to-noise ratio, and image visual quality. This is 
advantageous because some coefficients may be more significant and to these a larger 
value N may be assigned in order to obtain an exact representation. The significance of the 
coefficients can be determined, in accordance with the present invention, based on their 
1 5 energy and their corresponding subband. There are various known algorithms that can be 
used to represent an integer as the sum of signed or unsigned powers-of-two, as well as 
providing it to its nearest power-of-two representation. Selecting a particular algorithm 
will depend on the hardware or software implementation and its complexity. 

In accordance with the present invention, FIGs. 3, 4 A, 4B, and 5 represent various, 
20 but are not limited to, possible CSD coding methods of integer discrete wavelet transform 
coefficients for the optimization of overall system performance. Referring to FIG. 3, 
method 300 optimizes CSD conversion of a data signal, such as a finite input response 
(FIR) data signal, by optimizing the selection of the maximum number of terms, N, used to 
represent each wavelet integer coefficient. 
25 Step 302 begins by generating a filter bank (wavelet) to obtain integer wavelet 

coefficients. This filter bank includes an analysis filter bank, H, and a synthesis filter bank, 
G. The H filter bank is used in the decomposition stage 1 12 and represents the wavelet 
matrix for the encoder portion 1 10 of FIGs. 1 and 2. The G filter bank is used in the 
inverse decomposition stage 136 and represents the wavelet matrix for the decoder side 
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120. Next, a value is selected for N at step 304, N being the number of terms used to 
represent each integer wavelet coefficient in a powers-of two representation. 

Step 306 determines whether the same value of N is used for all coefficients of the 
analysis and synthesis wavelet filters and if not, then various values of N are selected 
5 according to the importance of the coefficient at step 308. The importance of the 

coefficient is determined by the energy associated with the coefficient's subband (i.e. Ns 
represents higher significant values of N, and NL represents lower significant values of N). 
If the same value of N is used at step 306, then the integer wavelet coefficients are coded 
using CSD at step 310 (i.e., H => H C sd and G => G C sd). 

1 0 Once the CSD-coding at step 3 1 0 is completed, the new coefficient values are 

substituted into their respective positions in the original analysis matrix, H, and synthesis 
matrix, G, to obtain new optimized matrices Hcsd and Gcsd whose components have been 
obtained using equation (5). The product of the coded analysis wavelet matrix H C sd and 
coded synthesis wavelet matrix G C sd, represented by the K-by-K sized matrix product 

15 (GcsdHcsd) is then compared to an identically sized identity matrix (I)K-by-K at step 312. 

For lossless systems and values of N so selected as to allow exact power-of-two 
representation of the original analysis (decomposition stage 1 12 of FIG. 1) and synthesis 
wavelet filter coefficients (inverse decomposition stage filter bank 136 of FIG. 1), the 
product GcsdHcsd should equal I^by-K. In this case, the predetermined reconstruction 

20 error, s, defined as the allowable difference between the input data signal s(n) and the 
recovered or reconstructed output data signal s'(n), should be zero, assuming lossless 
channel. Note that for 8=0, GcsdHcsd = Iic-by-K, and the system is lossless, thus s(n) = 
s'(n). 

For lossy systems, the reconstruction error, s, will not be zero. However, taking 
25 only into consideration the decomposition stage (represented by its analysis low pass filters 
and analysis high pass filters in the matrix Hcsd ) and the inverse decomposition stage 
(represented by its synthesis low pass filters and synthesis high pass filters in the matrix 
Gcsd) how small the reconstruction error, e , will be, will depend on how accurate the 
wavelet coefficients are CSD-coded, that is, it will depend on the value of N. 
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For lossy systems, where the quantization step may now be the limiting factor in 
the rate-distortion performance of the system, the value of N may be selected to allow a 
coarser power-of-two coefficient representation. If an unacceptable CSD conversion took 
place at step 3 12, the process moves to step 3 14 to increment the value of N. Steps 310, 
5 312, and 3 14 are repeated until an accepted CSD conversion takes place. If a successful 
conversion takes place at step 312 then the step of filtering the input signal using the 
optimized CSD-coded wavelet coefficients occurs at step 3 16. 

FIGs. 4A and 4B are examples of a more detailed implementation of the flowchart 
of FIG. 3. Step 402 begins by generating a filter bank to obtain integer wavelet 

1 0 coefficients. The integer wavelet is designed for both the analysis bank, H, used in the 
decomposition stage, and the synthesis bank, G, used in the inverse decomposition stage. 
Step 404 determines whether the same value of N is used for all coefficients of the analysis 
and synthesis wavelet filters. If so, a flag is set at step 406. 

If the same value of N was not determined at step 404, then a value is selected for 

15 N for significant coefficient(s), N s , at step 408, and a value is selected for N for less 
significant coefficient(s), N L , at step 4 1 0. Significant coefficients may be those 
corresponding to the lower frequency subbands, whereas less significant coefficients may 
be those corresponding to the higher frequency subbands. 

Next, low pass integer coefficients of the analysis bank are converted to CSD 

20 (power-of-two representation) at step 412, and, high pass integer wavelet coefficients of 
the analysis bank are converted to CSD at step 414, preferably using equation (5), but not 
limited to it. At step 416, an analysis wavelet matrix, H C sd> is constructed by substituting 
the coded coefficients into the original wavelet matrix H whose components were the 
original integer filter coefficients. 

25 Step 418 determines whether the flag was set at step 406, and if so, this implies 

that the synthesis bank, G, will use a different (either more precise or coarser) number of 
terms in the power-of-two terms representation of the synthesis coefficients, than those 
employed in the analysis CSD coding conversion. For this case, new values of N are 
selected for significant coefficients, N s , referred to as N s \ and for less significant 
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coefficients, N L , referred to as N L * at steps 422, 424 respectively. If the flag was not set at 
step 418, synthesis bank, G, will use the same value, N, as in the analysis bank as shown at 
step 420. 

At steps 426 and 428 the low pass and high pass wavelet coefficients of the 
5 synthesis bank, G, are CSD-coded to yield the coded synthesis matrix, Gcsd, at step 430. 

At step 432, the product of the coded analysis wavelet matrix, H C sd, and the coded 
synthesis wavelet matrix, Gcsd, represented by the k-by-k sized matrix product Gcsd H C sd 
is compared to the identity matrix I k ^y. k (Le., GcsdHcsd - 1 < e). If the difference is 
smaller than the predetermined reconstruction error, e, the CSD coding of all the 
10 coefficients in the decomposition stage (analysis bank) 112 and the inverse decomposition 
stage (synthesis bank) 136 yielded an acceptable powers-of-two conversion. Then, input 
signals 102 and 135 (for the lossy signal compression case FIG. 1) and signals 102 and 236 
(for the lossless case FIG. 2) are ready to be filtered using the optimized CSD-coded 
wavelet coefficients. 

15 If, at step 432, the difference between the matrix product Gcsd H C sd and the 

identity matrix, I, is greater than the reconstruction error, e, then the value(s) of the 
number of terms (N s , N L , N s ', and N L ') to be used in the powers-of-two representation are 
incremented at step 434. The incremented values are sent through steps 438, 440, 442, 
444 9 446, and 448 (repeating the process of steps 412, 414, 416, 426, 428, and 430 with 

20 the incremented N values) in order to obtain an updated matrix product for step 432. This 
loop is repeated until step 432 determines that an acceptable reconstruction error has been 
obtained, (i.e., that an acceptable CSD conversion has taken place). The final step filters 
the input signal using the optimized wavelet coefficients at step 436. 

FIG. 5 is a flowchart of a method 500 of optimizing CSD conversion of FIR 

25 integer wavelet coefficients in accordance with another embodiment of the invention. In 
this embodiment of the invention, the PSNR is optimized based on an input test image. 
Steps 502-510 are the same as 302-310 of FIG. 3. 
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Step 512 processes the test image, S T (z), through an analysis bank [Le., 
Hcsd(z)St(z)H' C sd(z) = X T (z)]. In this step the H'csd(z) is the transposed matrix of 
Hcsd(z). 

Next, the output X T (z) of the analysis bank gets processed through the synthesis 
5 bank at step 514 [i.e. G' C sd(z)Xt(z)Gcsd(z) = St(z)], where S T (z) is the recovered test 
image. 

The PSNR of the recovered image S T (z) is then calculated at step 516. The PSNR 

is then compared to a predetermined threshold of acceptable degradation. If the PSNR is 

determined to be unacceptable at step 518, then the selected N value(s) are incremented at 
10 step 520. If the PSNR is determined to be acceptable at step 518, then an acceptable 

CSD conversion has taken place, and the input signal(s) are now filtered using optimized 

CSD-coded wavelet coefficients at step 522. 

The adaptive CSD coding described in flowcharts 300, 400, and 500 is described in 

terms of integer wavelet coefficients. Alternatively, the CSD coding can be implemented 
15 with floating point wavelet coefficients, rounded-off wavelet coefficients, or truncated 

wavelet coefficients instead of the integer wavelet coefficients specified in steps 302, 402, 

and 502. 

Accordingly, there has been provided an apparatus and method of providing 
optimized filter banks for use in the decomposition stage of a digital data system. The 

20 wavelet filters of the present invention are designed in context of the entire data system 
and allow for a multiplierless system. The filter bank of the present invention provides the 
advantages of 1-D, 2-D, and 3-D filtering capability and can be used, but is not limited, to 
FIR and IIR filters in two-channel and multi-channel applications. 

While the preferred embodiments of the invention have been illustrated and 

25 described, it will be clear that the invention is not so limited. Numerous modifications, 
changes, variations, substitutions and equivalents will occur to those skilled in the art 
without departing from the spirit and scope of the present invention as defined by the 
appended claims. 
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